United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 

Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


09/870,202 


05/30/2001 


Senis Busayapongchai 


BELL-0095/00409 


7862 



7590 09/30/2004 

Woodcock Washburn Kurtz Mackiewicz & Norris LLP 

46th Floor 

One Liberty Place 

Philadelphia, PA 19103 



EXAMINER 



WOZNIAK, JAMES S 



ART UNIT 



PAPER NUMBER 



2655 

DATE MAILED: 09/30/2004 



Please find below and/or attached an Office communication concerning this application or proceeding. 



PTO 90C (Rev 10/03) 



Office Action Summary 


Application No. 

09/870,202 


Applicant(s) 

busayapongchai et al 


Examiner 

James S. Wozniak 


Art Unit 

2655 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )M Responsive to communication(s) filed on 7/8/2004 . 
2a)n This action is FINAL. 2b)IEI This action is non-final. 

3) 0 Since this application is in condition for allowance except for fomnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parfe Quay/e, 1935 CD. 11,453 0.0. 213. 

Disposition of Claims 

4) H Claim(s) 7-20 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) M Claim(s) 1-20 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10) [3 The drawing(s) filed on 30 May 2001 is/are: bM accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held In abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction Is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

11) n The oath or declaration Is objected to by the Examiner. Note the attached Office Action orforni PTO-152. 

Priority under 35 U.S.C. § 119 

12) n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)n All b)n Some * c)^ None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) 13 Notice of References Cited (PTO-892) 

2) O Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 

Paper No(s)/Mail Date . 



4) □ Interview Summary (PTO-413) 

Paper No(s)/Matl Date. • 

5) □ Notice of Informal Patent Application (PTO-152) 

6) □ Other: . 



U.S. Patent and Trademark Office 

PTOL-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper No./Mail Date 20040908 



Application/Control Number: 09/870,202 
Art Unit: 2655 



Page 2 



DETAILED ACTION 
Response to Amendment 

1. In response to the final office action from 4/13/2004, the applicant has submitted an 
amendment, filed 7/8/2004, amending claims 1 and 12, while arguing to traverse the art rejection 
based on the limitation regarding: "receiving a second speech input indicative of a second 
subject area associated with a second independent appUcation" (Amendment, Page 7). 
Applicant's arguments with respect to claims 1 and 12 have been considered but are moot in 
view of the new grounds of rejection in view of Balakrishnan (U.S. Patent: 6 ,233,559). 

Claim Objections 

2. Claim 20 is objected to under 37 CFR 1 .75(c), as being of improper dependent form for 
failing to further Umit the subject matter of a previous claim. Applicant is required to cancel the 
claim, or amend the claim to place the claim in proper dependent form, or rewrite the claim in 
independent form. 

The infringement test for determining a proper dependent claim as per the MPEP 608.01 
(n). Section III, states that a such a claim cannot conceivably be infringed by anything that would 
not also infringe the claim it references. In this case, a computer program product, such as a CD- 
ROM, would not infringe the method steps of Claim 1 since the program product itself never 
performs any of the active steps required by Claim 1. In other words possession of such a 
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program product would infringe Claim 20, but not Claim 1 . Therefore, Claim 20 is an improper 
dependent claim. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 1-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Douglas 
(UX Patent: 5,812,977) in view of Wang et al (U.S, Patent: 6,505,162), and further in view of 
Balakrishnan (U,S, Patent:_ 6,233,559), 

With respect to Claim 1, Douglas discloses: 

A method of speech recognition processing that provides audible information over a 
communications device comprising (user speech interface with a computer using a microphone 
as a communication means, Col. 5, Lines 52-60): 

Receiving a first speech input indicative of a first subject area (Fig, 3, Elements 76, 78, 
and 80); 

Initiating a first subject appHcation associated with said first subject area (Fig, 3, 
Element 88) (subroutine initiation upon reception of a speech input, Col 7, Lines 38-49)', 

Storing at least one indicator indicating a current processing step of said first subject 
appUcation (suspension of the present subroutine upon reception of a new task initiation 
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command; ''held in suspension suggests a well-known means, to one of ordinary skill in the art, 
of storing the progress of the first subroutine so as to return to a particular point of progress 
when the second application has been terminated, Col 9, Lines 51-56). 

Douglas does not disclose a method for storing context data of a first application in a 
context table, however Wang discloses: 

Storing a current context associated with the first subject application in a context table 
(hierarchical task description table used to store dialogue states, Col 3, Lines 51-52, and 
executed information from a previous application for use upon completing a task, Col 6, Lines 
50-61). 

Douglas in view of Wang does not specifically suggest receiving a second speech input 
indicative of a second independent appHcation, however, Balakrishnan discloses: 

Receiving a second speech input indicative of a second subject area associated with a 
second independent application (receiving speech data for a second speech application having 
an associated vocabulary. Col 5, Lines 41-61). 

Douglas, Wang, and Balakrishnan are analogous art because they are from a similar field 
of endeavor in speech-controlled systems. Thus, it would have been obvious to a person of 
ordinary skill in the art, at the time of invention, to modify the teachings of Douglas with the 
ability to store dialog states and executed information associated with a task in a table as taught 
by Wang and the ability to receive speech data for a second independent speech application as 
taught by Balakrishnan to provide a means of easily storing, organizing, and accessing task data 
in a table format to enable a user to switch between multiple speech applications without having 
to restait a particulai' task and implement convenient switching between speech applications 
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without the use of a keyboard or keypad and speech input routing to an appropriate appHcation 
(Balakrishnan, Col 7, Line 66- Col 2, Line 26). Therefore, it would have been obvious to 
combine Douglas, Wang, and Balakrishnan for the benefit of obtaining a command recognition 
method in which a user can easily switch between multiple independent applications without 
having to restart a particular task due to task data (task progress) stored in an organized and 
accessible table. 

With respect to Claim 2, Douglas additionally recites: 

The method according to claim 1, fiirther comprising initiating a second subject 
appHcation associated with said second subject area (example of a calculator subroutine 
(associated with the spoken command ''calculator'') initiated while a Reconcile bank account'' 
subroutine is suspended, Col 9, Lines 47-56). 

With respect to Claim 3, Douglas further discloses: 

The method according to claim 1, fiirther comprising initiating a task agent for said first 
subject application (task association and initiation through vocabulary word recognition, Col 5, 
Line 67- Col 6, Line 12, and task implementation through the use of windows, Col 8, Lines 60- 
65). 

With respect to Claim 4, Douglas further recites: 
The method according to claim 1, fiirther comprising monitoring said first speech input for at 
least one word indicative of said second subject area (recognition and initiation of a help 
subroutine at any time during task execution, Col 7, Line 63-Col 8, Line 8). 

With respect to Claim 5, Douglas additionally recites: 
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The method according to claim 1, further comprising suspending said first subject 
apphcation after receiving said second speech input (Col 9, Lines 51-56). 
With respect to Claim 6, Douglas further discloses: 

The method according to claim 5, fiirther comprising: receiving a further speech input, 
and re-activating said first subject application responsive to the further speech input (speech 
input of ''end task'' during the ''calculator" application, which returns the system to the 
"reconcile bank account'' subroutine, Col 9, Lines 51-59), 

With respect to Claim 1, Douglas additionally recites: 
The method according to claim 1, wherein said storing at least one indicator further comprises 
storing a series of indicators that indicate a processing path of said first application (use of a 
pointer, referring to the initial speech input, during the help subroutine such that the system 
knows at all times of the task sequence, what specific computer instruction is being executed, 
Col 8, Lines 2-9). 

With respect to Claim 8, Douglas additionally discloses: 

The method according to claim 7, fiirther comprising outputting a computer-generated 
representation of said stored series of indicators that indicates said processing path of said first 
application ("pointer" discussed above and indicative of each particular step of the "create a 
memo" subroutine, is represented in the form of an output fax or printed document of the entire 
memo created by the process, Col. 8, Lines 27-37). 

With respect to Claim 9, Douglas further discloses: 



Application/Control Number: 09/870,202 Page 7 

Art Unit: 2655 

The method according to claim 1, further comprising outputting information associated 
with said first appHcation in a first voice (synthesized or recorded voice response to task 
verification, Col. 6, Lines 33-37), 

With respect to Claim 10, Douglas additionally suggests: 
The method according to claim 9, fiirther comprising outputting information associated with a 
second application in a second voice, said second voice being distinguishable from said first 
voice (recorded voice that verifies commands in response to a system subroutine, Col 6, Lines 
30-37, and the ability of the user to specify reaction to system tasks, Col. 9, Line 66-CoL 10, 
Line 1, which implies an ability to select a recorded voice in association with a specific task 
response as a means of better identifying its function. Therefore, it would have been obvious to 
one of ordinary skill in the art, at the time of invention, to assign a specific voice, specified by 
user preference, with a task so as to offer an audible means of easily distinguishing between 
system tasks.). 

With respect to Claim 11, Douglas fiirther recites: 

The method according to claim 1, further comprising synthesizing speech for outputting 
speech from said first application (synthesized voice response to task verification, Col 6, Lines 
33-37). 

With respect to Claim 12, Douglas discloses: 
A speech recognition system comprising: 

A speech recognition module that processes speech input and translates said speech input 
into computer-readable input (conditioning circuit. Col. 5, Lines 54-58, Fig. 7, Element 22); 
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A control manager comprising: a module that interfaces between said speech input and at 
least one of a plurality of application programs (CPU, Col 5, Line 63'Col 6, Line 9, Fig, 7, 
Element S0)\ 

A module that initiates processing of a first application program (CPU, Col 6, Lines 6-9, 
Fig. 7, Element S0)\ 

A speech synthesizing module for providing output information from said plurality of 
appHcation programs (CPU, Fig.l, Element 30, Speaker, Fig. 1, Element 26, and synthesized 
voice response to task verification, Col 6, Lines 33-37), 

Douglas does not disclose a method for storing context data of a first appUcation in a 
context table, however Wang discloses: 

A module that stores a cuirent context of the first application program in a context table 
(hierarchical task description table used to store dialogue states. Col 3, Lines 51-52, and 
executed information from a previous application for use upon completing a task, Col 6, Lines 
50-61). 

Douglas in view of Wang does not specifically suggest receiving a second speech input 
indicative of a second independent appHcation, however, Balakrishnan discloses: 

A module that monitors said speech input for a request to initiate a second independent 
application program (receiving speech data for a second speech application having an 
associated vocabulary, Col 5, Lines 41-61). 

Douglas, Wang, Balakrishnan are analogous art because they are from a similar field of 
endeavor in speech-controlled systems. Thus, it would have been obvious to a person of 
ordinary skill in the art, at the time of invention, to modify the teachings of Douglas with the 
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ability to store dialog states and executed information associated with a task in a table as taught 
by Wang and the ability to receive speech data for a second independent speech application as 
taught by Balakrishnan to provide a means of easily storing, organizing, and accessing task data 
in a table format to enable a user to switch between multiple speech applications without having 
to restart a particular task and implement convenient switching between speech applications 
without the use of a keyboard or keypad and speech input routing to an appropriate application 
(Balakrishnan, Col I Line 66- Col 2, Line 26), Therefore, it would have been obvious to 
combine Douglas, Wang, and Balakrishnan for the benefit of obtaining a command recognition 
method in which a user can easily switch between multiple independent applications without 
having to restart a particular task due to task data (task progress) stored in an organized and 
accessible table. 

With respect to Claim 13, neither Douglas nor Balakrishnan does teach storing contexts 
related to a first and second application in a context table, however Wang further discloses: 

The system according to claim 12, wherein the context table maintains a first current 
context for said first application program and a second current context for said second 
application (storing information from a present application (task 2), previously having stored 
information from a previous task (task I) in a hierarchical task description table. Col 6, Lines 
50-61^ and stored information related to various subroutines. Fig. 8a,) 

Douglas, Wang, Balakrishnan are analogous art because they are from a similar field of 
endeavor in speech-controlled systems. Thus, it would have been obvious to a person of 
ordinary skill in the art, at the time of invention, to modify the teachings of Douglas and 
Balakrishnan with the ability to store task information related to individual applications as taught 
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by Wang to provide a means of easily storing, organizing, and accessing task data associated 
with a particular application in a table format to enable a user to switch between multiple speech 
applications without having to restart a particular task. Therefore, it would have been obvious to 
combine Douglas, Wang, and Balakrishnan for the benefit of obtaining a command recognition 
system and method in which a user can switch between multiple applications without having to 
restart a particular task due to task data (task progress) stored in an organized and accessible 
table. 

With respect to Claim 14, Douglas further recites: 

The system according to claim 12, further comprising a plurality of task agents, each task 
agent associated with one of said plurality of application programs (task association and 
initiation through the recognition of various vocabulary words, CoL 5, Line 67- CoL 6, Line 12, 
and task implementation through the use of windows, Col 8, Lines 60-65). 

With respect to Claim 15, Douglas additionally recites: 

The system according to claim 14, wherein the control manager is adapted to assign said 
application programs to said task agents, and switch control among said task agents (task 
implementation through windows and vocabulary word association as applied to Claim 14 and 
the multiple system tasks listed in Table 1 and stored in the CPU, CoL 7, Lines 20-22). 

With respect to Claim 16, Douglas further shows: 

The system according to claim 12, wherein the request comprises a control word (list of 
representative command words corresponding to subroutine initiation found in Table 1). 
With respect to Claim 17, Douglas additionally discloses: 
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The system according to claim 12, wherein the control manager is adapted to suspend 
said first application program, and initiate processing of said second application program, 
responsive to the request (Col. 9, Lines 51-56), 

With respect to Claim 18, Douglas further recites: 

The system according to claim 17, wherein the control manager is adapted to re-activate 
said first application program responsive to a fiirther request (speech input of ''end task" during 
the ''calculator'' application, which returns the system to the ''reconcile bank account'' 
subroutine, Col 9, Lines 51-59), 

With respect to Claim 19, Douglas further discloses: 

The system according to claim 12, wherein the control manager is adapted to store at 
least one indicator indicative of a current processing step of at least one of said plurality of 
application programs (use of a pointer, referring to the initial speech input, during the help 
subroutine such that the system knows at all times of the task sequence, what specific computer 
instruction is being executed, CoL 8, Lines 2-9). 

With respect to Claim 20, Douglas additionally suggests: 
A computer-readable medium for storing computer-executable instructions for 
performing the method of claim 1 (a voice control interface realized using a computer. Col, J, 
Lines 49-52; and the well-known method, to one skilled in the art, of initiating a computer 
process through the use of a program held on a storage medium common to a personal 
computer, for example, a CD-ROM or floppy drive). 
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Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure: 

• Pallakoff et al (U.S. Patent: 5,651,096)- discloses a computer-based speech 
recognition system capable of switching between independent applications having 
corresponding vocabularies. 

• Loats et al (US. Patent: 5,897,618)- teaches a means of operating multiple 
applications through speech input that utilizes a window to list all active 
apphcations. 

• Ortega et al (US. Patent: 6,182,046)- teaches a speech recognition system 
capable of operating multiple speech-enabled applications and monitoring 
available vocabulary based upon an application state. 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James S. Wozniak whose telephone number is (703) 305-8669 
and email is James.Wozniak@uspto.gov. The examiner can normally be reached on Mondays- 
Fridays, 8:30-4:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Doris To can be reached at (703) 305-4827. The fax/phone number for the 
Technology Center 2600 where this application is assigned is (703) 872-9306. 
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Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the technology center receptionist whose telephone number is (703) 306- 
0377. 

James S. Wozniak 
9/9/2004 




